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Dynamic Switching of a Communication Port in a Storage System Between Target and 

Initiator Modes 

FIELD OF THE INVENTION 

[0001] At least one embodiment of the present invention pertains to networked data 
storage systems, and more particularly, to a technique for dynamically switching the 
mode of a Fibre Channel port in a networked storage system between target mode and 
initiator mode. 
BACKGROUND 

[0002] A file server is a network-connected processing system that stores and 
manages shared files in a set of mass storage devices, such as disk drives, on behalf 
of one or more clients. Filer servers are used In many different applications, such as in 
data backup and recovery applications. Disks within a file system may be organized as 
one or more groups of Redundant An-ay of Independent/Inexpensive Disks (RAID). 
[0003] One configuration in which file servers can be used is a network attached 
storage (NAS) configuration. In a NAS configuration, a file server can be implemented 
in the form of an appliance that attaches to a network, such as a local area network 
(LAN), a corporate intranet, or the Internet. An example of such an appliance is any of 
the Filer products made by Network Appliance, Inc. in Sunnyvale, California. 
[0004] Another specialized type of network is a storage area network (SAN). A SAN 
is a highly efficient network of interconnected, shared mass storage devices. Such 
devices are also made by Network Appliance, Inc. One difference between NAS and 
SAN is that in a SAN the head provides a remote host with block-level access to stored 
data, whereas in a NAS configuration, the head nonnally provides clients with file-level 
access to stored data. 
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[0005] In this context, a "head" means all of the electronics, fimiware and/or software 
(the "intelligence") that is used to control access to a set of mass storage devices; a 
head does not include the mass storage devices themselves. In a file server, the head 
normally is where all of the "intelligence" of the file server resides. Note that a "head" in 
this context is not the same as, and is not to be confused with, the magnetic or optical 
head that is used to physically read or write data from or to the mass storage medium. 
[0006] A simple example of a storage network configuration is illustrated in Figure 1 . 
A filer (file server) "head" 2 is coupled locally to a set of mass storage devices 4, and to 
a set of clients 1 through an interconnect 3. The filer head 2 receives various read and 
write requests from the clients 1 and accesses the mass storage devices 4 to service 
those requests. Each of the clients 1 may be, for example, a conventional personal 
computer (PC), workstation, or the like. The mass storage devices 4 may be, for 
example, conventional magnetic tapes or disks, optical disks such as CD-ROM or DVD 
based storage, magneto-optical (MO) storage, or any other type of non-volatile storage 
devices suitable for storing large quantities of data. The filer head 2 can be configured 
and monitored from a management station 5, either via a direct coupling or via the 
network 3. 

[0007] In a NAS implementation, the interconnect 3 may be essentially any type of 
computer network, such as a local area network (LAN), a wide area network (WAN), 
metropolitan area network (MAN) or the Internet, and may implement the Internet 
Protocol (IP). In a SAN Implementation, the interconnect 3 may be a Fibre Channel 
(FC) switching fabric which implements the Fibre Channel Protocol (FCP). FCP Is the 
encapsulation for Small Computer System Interface (SCSI) over FC. 
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[0008] A device which connects to other devices via FC transport, such as the head 2 
in Figure 1 for example, generally includes an FC host bus adapter (hereinafter "FC 
adapter"). The FC adapter has one or more FC ports, to which the physical FC 
transport medium is connected. In accordance with FCP, an FC port operates as either 
a "target" or an "initiator. In the known prior art, whether a particular FC port operates 
as a target or an initiator is determined by the manufacturer of the FC adapter, at the 
factory. For example, at least one well-known FC adapter has a built-in nonvolatile 
random access memory (NVRAM), which stores a target/initiator mode flag that 
determines the adapter type. This flag is read during boot up to determine which driver 
gets attached to the port(s), to detemriine whether the port(s) of the FC adapter operate 
as target or initiator. However, this flag is set by the manufacturer and cannot be 
modified in the field. 

[0009] In various situations, however, it would be desirable to have the ability to 
switch the role of an FC port from target to initiator or vice versa dynamically in the field. 
For example, certain Filers made by Network Appliance are capable of operating in a 
NAS mode or a SAN mode or both modes at the same time. In such a dual-use 
devices (also refen-ed to as "unified" storage devices), it would be desirable to have the 
ability to dynamically change the operating mode of an FC port between target and 
initiator, to more fully take advantage of the versatility of the device. 
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SUMMARY OF THE INVENTION 

[0010] The present invention includes a storage system which connprises a 
communication port having a mode of operation that can be dynamically switched 
between a target mode and an initiator mode, and a method for dynamically switching 
the mode of operation of the port in response to user input from a user of the storage 
system. 

[0011] Other aspects of the invention will be apparent from the accompanying figures 
and from the detailed description which follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[00121 One or more embodiments of the present invention are illustrated by way of 

example and not limitation in the figures of the accompanying drawings, in which like 

references indicate similar elements and In which: 

[0013] Figure 1 illustrates an example of a storage network configuration; 

[0014] Figure 2 is a high-level block diagram of a multiple-head stand-alone storage 

system; 

[0015] Figure 3 is a block diagram of a single-board head for use in the storage 
system of Figure 2; 

[0016] Figure 4 illustrates a process flow in response to a "License add <fcp>" 
command; 

[0017] Figure 5 illustrates a process flow in response to a "License delete fcp" 
command; 

[0018] Figure 6 illustrates a process flow in response to a "Storage enable adapter" 
command; 

[0019] Figure 7 illustrates a portion of the boot process of a head of a storage system 
for dynamic configuration of FC port mode; 

[0020] Figure 8 illustrates a network configuration in which a Fibre Channel (FC) port 
on a head Is used in the target mode to connect the head through an FC fabric to a set 
of clients; 

[0021] Figure 9 illustrates a network configuration in which an FC port on a head is 
used in the initiator mode to connect the head to a SAN-based tape backup system; 
and 
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[0022] Figure 10 illustrates a network configuration in which an FC port on a head is 
used in the initiator mode as an additional connection between the head and a set of 
disks. 
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DETAILED DESCRIPTION 

[00231 A method and apparatus for dynamically switching the operational mode of a 
Fibre Channel (FC) port in a storage system between target mode and initiator mode 
are described. Note that in this description, references to "one embodimenf or "an 
embodimenf mean that the feature being referred to is included in at least one 
embodiment of the present invention. Further, separate references to "one 
embodiment" or "an embodiment" in this description do not necessarily refer to the 
same embodiment; however, such embodiments are also not mutually exclusive unless 
so stated, and except as will be readily apparent to those skilled in the art from the 
description. For example, a feature, structure, act, etc. described in one embodiment 
may also be included in other embodiments. Thus, the present invention can include a 
variety of combinations and/or integrations of the embodiments described herein. 
[0024] Figure 2 is a hardware layout block diagram of a storage system 71 , which In 
certain embodiments can be dynamically configured (or reconfigured) to operate as 
either a NAS filer or a SAN device or both. All of the components of the storage system 
71 are contained within a single chassis, so that the storage system 71 is capable of 
operating as a stand-alone file server. An example of a device with such capability is 
any of the FAS2xx series Storage Systems from Network Appliance. Note that this 
architecture is used here only as an example, to facilitate description. The techniques 
introduced herein are not limited in application to the architecture shown in Figure 2. 
[0025] In the illustrated embodiment, the major components of the system 71 are 
connected to, and communicate via, a passive backplane 51 . The backplane 51 is 
"passive" in that it has no active electronic circuitry mounted on or in it; it is just a 
passive communications medium. For example, the backplane 51 can be essentially 
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comprised of just one or more substantially planar substrate layers (which may be 
conductive or which may be dielectric with conductive traces disposed on/in it), with 
various pin-and-socket type connectors mounted on it to allow connection to other 
components inside the chassis. 

[0026] Connected to the backplane 51 are a number of independent heads 64 and a 
number of internal hard disk drives 23. The heads 64 may be configured to operate as 
a clustered failover (CFO) pair, if desired. Not shown are various other components of 
the storage system 71 which are not germane to the present invention, such as one or 
more power supplies, input/output (I/O) modules, etc. 

[0027] Each of the heads 64 has at least one network connection 95, such as an 
Ethemet connection, by which the heads 64 can communicate over a network with 
external devices, such as clients and/or a management station. In addition, each of the 
heads 64 has at least one external FC port 102 to connect the head 64 to external 
mass storage devices (e.g., disks) and another external FC port 102A, which can be 
used for various purposes as described below. 

[0028] To facilitate description, it is generally assumed herein that each port 1 02A is 
used to implement SCSI commands over FC. However, the techniques described 
below are not limited to such an implementation. For example, the principles described 
herein can be easily adapted to dynamically reconfigure an Internet SCSI (iSCSI) port 
between target and initiator modes; to dynamically reconfigure a parallel SCSI port 
between target and initiator modes; to dynamically reconfigure a serial ATA port 
between target and initiator modes; or potentially to dynamically reconfigure any other 
type of data communication port between target and initiator modes. 
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[0029] The technique described below allows the external FC port 102A on each head 
64 to be dynamically reconfigured as either an FC target or an FC initiator, in the field, 
while the storage system 71 is in operation. Of course, in various embodiments a 
storage system may have more than one port which is reconfigurable In this way. 
Among other advantages, the dynamic reconfigurability of FC port 102A enables users 
to more fully benefit from the dual NAS/SAN capability of the storage system 71, as 
further described now with reference to Figures 8 through 10. 
[0030] When configured in the target mode, for example, the port 102A can be used 
to provide a head with a connection to a set of clients, separately from its standard 
network connection, as shown in Figure 8. In Figure 8, a head 64 in storage system 71 
(only one head 64 is shown, to simplify the illustration) can be connected via its network 
connection 95 through a standard IP network to a first group of clients 83A, while it Is 
connected via its FC port 102A through an FC fabric 82 to a second group of clients 
83B. In this way, the head 64 may operate in a NAS mode to serve files to clients 83A 
while operating in a SAN mode to serve blocks to clients 83B. 
[0031] Alternatively, the FC port 102A may be configured in the initiator mode. 
Among other applications, using FC port 102A in the initiator mode enables the head 64 
to be connected via port 102A through an FC fabric 100 to a SAN-based tape backup 
system 101 , separately from its connection to the disk drives 4, as shown in Figure 9. 
Another possible use of the FC port 102A in the initiator mode is to provide the head 64 
with an additional connection to the disks 4, to increase bandwidth and/or to provide 
connection redundancy to and from the disks 4. 

[0032] In the known prior art, there is no way for a user to dynamically reconfigure an 
FC port from target to initiator or vice versa. Thus, in the known prior art, there is no 
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easy way to take advantage of an available FC port to switch a dual NAS/SAN storage 
system, such as storage system 71 , between various possible network configurations, 
such as those shown in Figures 8 through 10. The present invention, however, 
provides such capability. 

[0033] Figure 3 is a block diagram of a head 64, according to certain embodiments of 
the invention. In the illustrated embodiment, all of the components of the head 64 are 
Implemented on a single circuit board 80. The head 64 includes a microprocessor 91, 
dynamic read-only memory (DRAM) 92 in the form of one or more dual inline memory 
modules (DIMMs), an integrated circuit FC adapter 93, a number of FC ports 102 and 
102A, and a number of Fibre Channel IC port bypass circuits (PBCs) 94. The 
processor 91 controls the operation of the head 64. The DRAM 92 serves as the main 
memory of the head 64 and is used by the processor 91 . 

[0034] The PBCs 94 are connected to the processor 91 through the FC adapter 93 
and can be connected to the passive backplane 51 through standard pin-and-socket 
type connectors (not shown) on the circuit board 80 and the backplane 51 . The PBCs 
94 are connected to the FC adapter 93 in a loop configuration. Each PBC 94 can 
communicate (through the backplane 51) separately with the internal disk drives 23 
installed within the same chassis (see Figure 2). Each PBC 94 provides loop resiliency 
relative to certain disk drives for which it is responsible, by bypassing a failed disk drive 
in the event of failure. 

[0035] The head 64 also includes a number (three in the illustrated embodiment) of 
integrated circuit Ethernet adapters 95. In the illustrated embodiment, two of the 
Ethernet adapters 95 are coupled to extemal connectors to allow them to be connected 
to devices outside the chassis for network communication (e.g., to clients and/or a 
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management station). The third Ethemet adapter 95A is connected only to the 
backplane 51 and is used only for head-to-head communication. 
[0036] The head 64 further includes a standard RJ-45 connector 96 which is coupled 
to the processor 91 through a standard RS-232 transceiver 97. This connector- 
transceiver pair 96 and 97 allows a management station to be connected to the head 
64, for purposes of remotely monitoring or configuring the head 64 or other 
administrative purposes. 

[0037] The head 64 also includes at least one non-volatile memory 98 (e.g., Flash 
memory or the like). The non-volatile memory 98 stores information such as boot 
firmware, a boot image, test software and the like. 

[0038] The head 64 further includes a number of FC ports 1 02 and 1 02A to allow 
connection of the head 64 to external components using FCP. One of the FC ports 
102A is coupled directly to the FC adapter 93. while another FC port 102 is coupled to 
the FC adapter 93 through one of the PBCs 94. 

[0039] Although the system 71 can operate as a standalone file server without any 
external disk drives, it may nonetheless be desirable in some situations to connect one 
or more extemal mass storage devices to the system 71. Accordingly, FC port 102A 
can be used (in initiator mode) to connect the head 64 to such external mass storage 
devlce(s). Alternatively. FC port 102A can be used for various other purposes, such as 
to connect the head 64 to a SAN-based tape backup system (in initiator mode) or to 
connect the head 64 to a set of clients (in target mode). 

[0040] As noted above, in certain embodiments the processor 91 is programmed (by 
instructions and data stored in memory 92 and/or in memory 98) so that the head 46 is 
simultaneously operable as both a NAS filer (using file-level accesses to stored data) 
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and a SAN storage system (using block-level accesses to stored data), i.e., to operate 
as a "unified" storage device, sometimes refenred to as fabric attached storage (FAS) 
device. In other embodiments, the head 64 may be programmed so that the enclosure 
is operable as either a NAS file server or a SAN storage device, but not at the same 
time, where the mode of operation can be determined after deployment according to a 
selection by a user (e.g., a network administrator). 

[0041] To facilitate this versatility of the storage system 71 . the external FC port 1 02A 
can be dynamically configured to operate in either FCP target mode or FCP initiator 
mode, as desired. Users of the storage system 71 who acquire an FCP license will 
generally want the extemal FC port 102A to operate in FCP target mode, whereas 
users who do not may want the port 102A to operate in the FCP initiator mode, such as 
to support SAN enabled backups. This dynamic switching capability is made possible, 
in part, by creating a Boolean variable. FCP-TARGET-MODE, which is stored in the 
non-volatile memory 98 of the head 64. Note this variable is not stored in NVRAM 
within the FC adapter 93 (if any). The FC adapter 93 may include its own internal 
NVRAM, which may store a target/initiator mode flag set by the manufacturer; however, 
any such flag set by the manufacturer is ignored according to the techniques introduced 
herein. 

[0042] By changing the state of FCP-TARGET-MODE, the operational mode of FC 
port 102A is switched from target mode to initiator mode or vice versa. The state of this 
variable is dependent upon whether or not FCP has been licensed for use with the 
storage system 71. To configure port 102A in the target mode, the user of the storage 
system 71 licenses FCP and reboots the storage system 71. Once configured in the 
target mode, the user can reconfigure port 102A for initiator mode by unlicensing FCP 
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and rebooting the storage system 71. The licensing or unlicensing of FCP (and other 
user actions for controlling the storage system 71) can be accomplished by applying 
appropriate user input at a management station, for example, using a user interface 
generated by the storage system 71 . 

[0043] The technique for dynamically reconfiguring port 1 02A will now be described in 
further detail with reference to Figures 4 through 7. Referring now to Figure 4, FCP is 
licensed by the user's inputting the command "License add <fcp>" at block 401 to a 
user interface of the storage system 71 , where the parameter <fcp> represents the 
license key. This command causes FCP-TARGET-MODE to be set to Tme at block 
403, after which the user is prompted at block 403 to reboot the system 71 to enable 
FCP service. 

[0044] Referring now to Figure 5, FCP can be unlicensed by the user's inputting the 
command "License delete fcp" to the storage system 71 at block 501 . This command 
causes FCP-TARGET-MODE to be set to False at block 502, after which the user is 
prompted at block 503 to reboot the system 71 to enable FCP initiator mode. 
[0045] In certain embodiments, during the first boot up after the system 71 has been 
deployed, it is necessary to put port 102A online to enable initiator mode operation. 
Accordingly, referring to Figure 6, this is done by the user's inputting the command 
"Storage enable adapter" at block 601 , which causes a Boolean variable called 
SAN.SERVICE to be set to True at block 602. The use of the aforementioned variables 
is further described with reference to Figure 7. 

[0046] Figure 7 illustrates the relevant portion of the boot process of a head 64 in 
storage system 71, according to certain embodiments of the invention, for dynamic 
configuration of the FC port mode. Initially, the process checks the status of FCP- 
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TARGET-MODE at block 701 . If FCP-TARGET-MODE is set to True, then the following 
operations are performed: First, at block 702 the process attaches (selects for use) the 
PC target driver (software) to port 102A. It can be assumed that an appropriate FC 
target driver and an appropriate FC initiator driver are both available in local storage on 
the head 64 for use as needed, e.g., included as part of the operating system of the 
head 64. Note that in other embodiments, however, both the initiator functionality and 
the target functionality may be provided in a single driver, where the appropriate 
functionality of the driver is invoked according to whether target mode or initiator mode 
is desired. 

[0047] After block 702, the process enables port 1 02A at block 703 and then waits 
until the root volume (i.e., the file system) of the head 64 has been mounted at block 
704. After the root volume has been mounted, the process detemiines at block 705 
whether FCP is currently licensed for use with storage system 71 . If FCP is licensed, 
then the process starts FCP service at block 706. If FCP is not licensed, then the 
process sets FCP-TARGET-MODE to False at block 707 and generates a prompt to the 
user to reboot the system to enable the initiator mode at block 708. 
[00481 Referring again to block 701 , if FCP-TARGET-MODE is not set to True, then 
the following operations are performed: First, at block 709 the process attaches the FC 
initiator driver to port 102A. Next, the process disables port 102A at block 710 and then 
waits until the root volume of the head 64 has been mounted at block 71 1 . After the 
root volume has been mounted, the process determines at block 712 whether FCP is 
licensed for use with storage system 71 . If FCP Is licensed, then the process sets FCP- 
TARGET-MODE to True at block 713 and initiates an automatic reboot at block 714. If 
FCP is not licensed, then the process detemiines whether SAN.SERVICE is True at 
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block 715. If SAN.SERVICE is True, then the process enables port 102A at block 716; 
otherwise, the process ends at block 715. 

[00491 Thus, a method and apparatus for dynamically switching the mode of a Fibre 
Channel port in a storage system between target mode and initiator mode have been 
described. Although the present invention has been described with reference to 
specific exemplary embodiments, it will be recognized that the invention is not limited to 
the embodiments described, but can be practiced with modification and alteration within 
the spirit and scope of the appended claims. Accordingly, the specification and 
drawings are to be regarded in an illustrative sense rather than a restrictive sense. 
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